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(54) Biometric information obtaining apparatus 

(57) The apparatus enables a user to recognize the 
way he is moving his finger with respect to, for example, 
a sweep-type fingerprint sensor so that the user can 
easily and surely learn an appropriate way the finger 
(body part) should be moved. A velocity detecting 
means (202) detects a velocity at which the body part 
moves with respect to a sensor (10), and an image gen- 
erating means (206) generates an arbitrary pattern, of 
which a portion corresponding to a position where the 
body part is located when the movement velocity is de- 
tected is altered according to the detected movement 
velocity, and the generated pattern is shown on a display 
(30). 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention: 

[0001] The present invention relates to an apparatus 
that obtains biometric information, such as a fingerprint, 
palm print, blood vessel arrangement, and so on, for us- 
er authentication. More precisely, the invention relates 
to a biometric information obtaining apparatus with a 
sweep-type fingerprint sensor, which apparatus obtains 
a series of partial images (fingerprint images) of a finger 
while it is moving with respect to the sensor surface (im- 
age-obtaining surface). 

2. Description of the Related Art: 

[0002] Wilh recent improvements in performance of 
compact information equipment, such as mobile phones 
and PDAs (Personal Digital Assistants), such equip- 
ment has increasingly been used to access communi- 
cation networks and to store great amounts of user in- 
formation therein, so that the need for improving the se- 
curity performance of the equipment has been strongly 
emphasized. 

[0003] For attaining a high level of security of such 
equipment, it is conceivable to employ a previous user 
authentication system that uses a password and an ID 
(Identification) having been commonly used. However, 
because of the problem that passwords and ID cards 
are susceptible to theft, a user authentication (verifying 
a current user of equipment as a previously registered 
user) system with higher security has been desired. To 
meet this demand, user authentication by human body 
part characteristics (biometric information) is consid- 
ered a good method with high security, and in particular, 
fingerprint verification is advantageous in user conven- 
ience. 

[0004] For fingerprint verification, an electrostatic fin- 
gerprint sensor or an optical fingerprint sensor is used 
to obtain a fingerprint (a pattern made of ridges that con- 
tact with the sensor surface and ditches that do not con- 
tact therewith) from a fingertip of a user who is to be 
identified. From a foreground image (for example, an im- 
age of ridges) of the fingerprint, its minutiae information 
(for example, information of branch points and end 
points of ridges) is extracted to be compared with reg- 
istration minutia information that is previously obtained 
and registered as reference information for verification. 
In this manner, a user is identified, that is, user authen- 
tication is performed. 

[0005] Generally speaking, a common type of finger- 
print sensor (hereinafter sometimes called a flat type fin- 
gerprint sensor) for obtaining a fingerprint image from a 
user to be identified, is normally equipped with a sensor 
surface (image-obtaining surface) larger than the size 
of a human fingertip. Recently, however, for the purpose 
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of introducing a fingerprint sensor in compact informa- 
tion equipment, such as a mobile phone or a PDA, the 
sensor surface is down-sized to be smaller than a hu- 
man fingertip, and a sequence of partial images of a fin- 
5 gerprint are obtained through the sensor surface and 
then combined to regenerate the whole image of the fin- 
gerprint. 

[0006] A sweep-type fingerprint sensor is one of the 
fingerprint sensors ready for such a recent situation (for 
10 example, refer to the following patent applications 1 and 
2). The sweep-type fingerprint sensor has a small-sized 
rectangular image-obtaining surface (sensor surface/ 
image capture surface) having a length sufficiently 
shorter than that of a human fingertip. While a finger is 
is moving with respect to the image-obtaining surface or 
while the image-obtaining surface (fingerprint sensor) is 
moving with respect to the finger, the fingerprint sensor 
obtains a series of partial images of the fingerprint, 
based on which the whole image thereof is then recon- 
structed. From the thus-reconstructed f ingerprint image, 
information of fingerprint minutiae (branch points and 
end points of ridges) is extracted/generated, and on the 
basis of the information, user authentication is per- 
formed. Hero, note that such a relative movement be- 
tween a finger and an image-obtaining surface is called 
a "sweep;- 1 

[0007] Such a sweep-type fingerprint sensor has a 
problem of deteriorating verification performance, which 
is more frequent in this type of sensor than in a flat type 
sensor, because finger movement with respect to the 
sensor surface can distort the surface skin of the finger 
or reduce the area of a fingerprint image obtained. Ac- 
cordingly, most of the users need to learn and practice 
howtomove their fingers, resulting in lowered user con- 
venience in comparison with a flat type fingerprint sen- 
sor. In order to learn appropriate finger movement, it is 
essential for a user to be aware of his finger's current 
movement. 

[0008] Both of the techniques disclosed in the follow- 
ing patent applications 1 and 2, however, delete infor- 
mation about finger movement, without offering a user 
any of the information. They show only a reconstructed 
image of a finger after the finger finishes with its move- 
ment or a verification result alone. Therefore, if failure 
in reconstruction of a fingerprint image or in fingerprint 
verification is caused by inappropriate finger movement, 
a user is nol notified about the cause of the failure. 
[0009] In the meantime : the following patent applica- 
tions 3 and 4, for example, disclose techniques of guid- 
ing a user to put his finger at a correct position on a flat 
type fingerprint sensor. These techniques aim at detect- 
ing a positional relationship between the center of a sen- 
sor and a finger so as to lead the finger into the sensor 
center. Therefore, even if these techniques are applied 
to a sweep-type fingerprint sensor, it is still impossible 
to detect what causes distortion of a fingerprint image, 
so that a user still cannot recognize the fact that the dis- 
torted fingerprint image (that is, failure in fingerprint im- 
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age reconstruction and in fingerprint verification) results 
from his erroneous finger movement. A flat type finger- 
print sensor obtains such a fingerprint image as is 
shown in FIG. 32B, under a condition where a finger 1 01 
is laid still on a sensor surface (image-obtaining surface) 
1 00 as shown in FIG. 32A. Accordingly, the flat type sen- 
sor needs an instruction as to where a finger 101 should 
be placed with respect to the sensor surface 100, but 
has no need at all for real-time display/instruction of 
movement of a finger 101 . 

[Patent application 1] Japanese Patent Application 

Laid-open No. HEI 1 0-091 769 

[Patent application 2] Japanese Patent Application 

Laid-open No. HEI 11-253428 

[Patent application 3] Japanese Patent Application 

Laid-open No. 2002-288643 

[Patent application 4] Japanese Patent Application 

Laid-open No. 2002-177623 

[0010] Against the background of the above patent 
applications 1-4, a technique has been desired whereby 
a user of a sweep-type fingerprint sensor can recognize 
inappropriate finger movement which causes distorted 
fingerprint images (that is, failure in fingerprint image re- 
construction and in fingerprint verification). 

SUMMARY OF THE INVENTION 

[0011] With the foregoing problems in view, one ob- 
ject of the present invention is enabling a user of a 
sweep-type fingerprint sensor to recognize the way he 
is moving his finger so as to easily and surely learn an 
appropriate way he should move his finger, for attaining 
improvement in verification performance and user con- 
venience. 

[0012] In order to accomplish the above objects, ac- 
cording to the present invention, there is provided a bi- 
ometric information obtaining apparatus that comprises: 
a biometric information obtaining means for reading a 
living individual* s body part during a relative movement 
between the body part and the biometric information ob- 
taining means, and for obtaining a series of partial im- 
ages of the body part as biometric information; a velocity 
detecting means for detecting a movement velocity at 
which the body part moves with respect to the biometric 
information obtaining means; an image generating 
means for generating an arbitrary pattern, of which a 
portion corresponding to a position where the body part 
locates at the movement velocity detection performed 
is altered according to the movement velocity detected 
by the velocity detecting means; and a display for show- 
ing thereon the arbitrary pattern generated by the image 
generating means. 

[0013] As another generic feature, there is provided 
a biometric information obtaining apparatus that com- 
prises: a biometric information obtaining means for 
reading a living individual' s body part during a relative 
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movement between the body part and the biometric in- 
formation obtaining means, and for obtaining a series of 
partial images of the body part as biometric information; 
a velocity detecting means for detecting a movement ve- 
5 locity at which the body part moves in relation to the bi- 
ometric information obtaining means; an evaluating 
means for evaluating whether or not the movement ve- 
locity, which is detected by the velocity detecting means, 
is within a permissible range, which depends on a prop- 
10 erty of the biometric information obtaining means; and 
a notifying means for notifying, if the above evaluation 
result of the evaluating means is negative (that is, if the 
detected movement velocity is out of the above permis- 
sible range), about the negative evaluation result. 
[0014] As one preferred feature, the biometric infor- 
mation obtaining apparatus further comprises a move- 
ment amount detecting means for detecting, based on 
a relative positional relationship between two partial im- 
ages successively obtained by the biometric information 
obtaining means, an amount of movement of the body 
part for a time interval at which such partial image is 
obtained by the biometric information obtaining means. 
The velocity detecting means calculates the movement 
velocity based on the movement amount of the body 
part detected by the movement amount detecting 
means and the time interval at which such partial image 
obtaining is performed. 

[0015] As another preferred feature, if the movement 
amount detected by the movement amount detecting 
means is within a range of detection errors, the move- 
ment amount detecting means holds a former one of the 
two partial images, which are used in detecting the 
movement amount, as a reference image, and newly de- 
tects such movement amount of the body part based on 
a relative positional relationship between the reference 
image and another partial image obtained subsequently 
to a later one of the two partial images. 
[0016] As still another preferred feature, the biometric 
information obtaining apparatus further comprises a po- 
sition detectingmeans for detecting a positional change 
of the body part by accumulating such movement 
amounts detected by the movement amount detecting 
means. At this time, the apparatus further comprises: a 
sideways deviation detecting means for detecting a 
sideways deviation of the body part based on the abso- 
lute value of the positional change, detected by the po- 
sition delecting means, in a direction perpendicular to a 
main movement direction in which the body part is ex- 
pected to move with respect to the biometric information 
obtaining means; and a notifying means for notifying, if 
such sideways deviation is detected by the sideways de- 
viation detecting means, about the detection result. In 
addition, the apparatus further comprises: a serpentine 
movement detecting means for detecting serpentine 
movement based on the followings: the absolute value 
of the positional change, detected by the position de- 
tecting means, in a direction perpendicular to a main 
movement direction along which the body part is expect- 
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ed to move with respect to the biometric information ob- 
taining means; and the number of times the body part 
reverses its movement direction along the perpendicu- 
lar direction; and a notifying means for notifying, if such 
serpentine movement is detected by the serpentine 
movement detecting means, about the detection result. 
[0017] As a further preferred feature, the biometric in- 
formation obtaining apparatus further comprises: a 
movement direction variation detectingmeans for de- 
tecting, based on a relative positional relationship be- 
tween two partial images successively obtained by the 
biometric information obtaining means, a movement di- 
rection variation of the body part for a time interval at 
which such partial image is obtained by the biometric 
information obtaining means; and a direction detecting 
means for detecting a movement direction change of the 
body part by accumulating such movement direction 
variations of the body part detected by the directional 
change amount delecting means. At this lime, if Ihe 
movement direction variation detected by the move- 
ment direction variation detecting means is within a 
range of detection errors, the movement direction vari- 
ation detecting means holds a former one of the two par- 
tial images, which have been used for detecting the 
movement direction variation, as a reference image, 
and newly, detects such movement direction variation of 
the body part based on a relative positional relationship 
between the reference image and another partial image 
obtained subsequently to a later one of the two partial 
images. In addition, the biometric information obtaining 
apparatus further comprises; a twist detecting means for 
detecting, based on the movement direction change de- 
tected by the direction detecting means, twist movement 
of the body part as a situation where the two partial im- 
ages, for use in detecting the movement velocity by the 
velocity detecting means, cross each other; and a noti- 
fying means for notifying, if such twist movement of the 
body part is detected by the notifying means, about the 
detection result. 

[0018] The biometric information obtaining apparatus 
of the present invention guarantees the following advan- 
tageous results. 

[0019] The velocity detecting means detects a move- 
ment velocity of the body part in relation to the biometric 
information obtaining means (a sweep-type fingerprint 
sensor, for example), and the image generating means 
generates an arbitrary pallern of which portions corre- 
sponding to positions where the body part locates when 
the movement velocity is detected are altered in position 
and size according to the detected movement velocity, 
and the arbitrary pattern is shown on the display. As a 
result, it is possible for a user to recognize a current 
movement of the body part with respect to the biometric 
information obtaining means simply by referring to the 
display, so that the user can easily and surely learn in 
what way the body part should be moved on the biomet- 
ric information obtaining means, the verification per- 
formance of the apparatus and the convenience of users 



being thereby improved. 

[0020] Further, the evaluating means evaluates 
whether or not the movement velocity, which is detected 
by the velocity detecting means, is within a permissible 
5 range, which depends on a property of the biometric in- 
formation obtaining means, and the notifying means no- 
tifies, if the above evaluation result of the evaluating- 
means is negative (that is, if the detected movement ve- 
locity is out of the above permissible range), about the 
negative evaluation result. With this notification by the 
notification means, a user can recognize an inappropri- 
ate motion of the body part (forexample, a too quick 
movement such that the partial images obtained by the 
biometric information obtaining means do not sufficient- 
ly overlap one another thereby making it impossible to 
detect the movement velocity and to reconstruct the par- 
tial image into the whole image). As a result, it is possible 
for the user to easily and surely learn in what way the 
body part should move on Ihe biometric informalion ob- 
taining means, verification performance and user con- 
venience being thereby improved. 
[0021 ] Furthermore, the velocity detecting means de- 
tects a movement amount of the body part for an image- 
obtaining time interval, based on a relative positional re- 
lationship between two partial images successively ob- 
tained from the body part, and on the basis of the de- 
tected movement amount and the image-obtaining time 
interval, a movement velocity of the body part can be 
extremely easily obtained with high accuracy. 
[0022] Here, if the movement amount detected by the 
movement amount detecting means is within a range of 
detection errors, the movement amount detecting 
means holds the former one of the two partial images, 
which are used in detecting the movement amount, as. 
a reference image, and newly detects such a movement, 
amount of the body part based on a relative positional 
relationship between the reference image and another 
partial image obtained subsequently to the later one of 
the two partial images. As a result, even if movement 
amounts smaller than a detection error (one pixel, for 
example) are consecutively detected, the detection er- 
rors are surely prevented from being accumulated, so 
that their effects can be minimized. In addition, since the 
current reference image is held without being updated, 
a reference image updating processing can be skipped, 
thereby shortening processing time. 
[0023] A position detecting means accumulates such 
movement amounts detected by the movement amount 
detecting means thereby extremely easily detecting a 
positional change of the body part with high accuracy. 
[0024] If a sideways deviation of the body part is de- 
tected based on the absolute value of the positional 
change, detected by the position detecting means in a 
direction perpendicular to the main movement direction 
in which the body part is expected to move, a notifying 
means notifies about the detection result. As a result, it 
is possible for a user to recognize a sideway deviation, 
an inappropriate motion of the body part, so that the user 
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can easily and surely learn in what way the body part 
should move on the biometric information obtaining 
means, verification performance and user convenience 
being thereby improved. 

[0025] In addition, if a serpentine movement of the 5 
body part is detected based on the followings: the ab- 
solute value of the positional change, detected by the 
position detecting means, in a direction perpendicular 
to the main movement direction along which the body 
part is expected to move; and the number of times the 10 
body part reverses its movement direction along the per- 
pendicular direction, a notifying means notifies about 
the detection result. As a result, it is possible for a user 
to recognize a serpentine movement, an inappropriate 
motion of the body part, so that the user can easily and is 
surely learn in what way the body part should move on 
the biometric information obtaining means, verification 
performance and user convenience being thereby im- 
proved. 

[0026] Moreover, a movement direction variation de- 20 
tecting means detects, based on a relative positional re- 
lationship between two partial images successively ob- 
tained from the body part, a movement direction varia- 
tion of the body part for a time interval at which such 
partial image is obtained, and a direction detecting 25 
means accumulates such movement direction varia- 
tions, thereby extremely easily detecting a movement 
direction change of the body part with high accuracy. 
[0027] Here, if the movement direction variation de- 
tected by the movement amount detecting means is 30 
within a range of detection errors, the movement direc- 
tion variation detecting means holds the former one of 
the two partial images, which are used in detecting the 
movement direction variation, as a reference image, 
and newly detects such a movement direction variation 35 
of the body part based on a relative positional relation- 
ship between the reference image and another partial 
image obtained subsequently to the later one of the two 
partial images. As a result, even if movement direction 
variations smaller than a detection error (one pixel, for 40 
example) are consecutively detected, the detection er- 
rors are surely prevented from being accumulated, so 
that their effects can be minimized. In addition, since the 
current reference image is held without being updated, 
a reference image-updating processing can be skipped, 45 
so that processing time is shortened. 
[0028] At this time, if a twist movemenl of the body 
part is detected, based on the movement direction 
change detected by the direction detecting means, as a 
situation where the two partial images, used in detecting so 
the movement velocity by the velocity detecting means, 
cross each other, a notifying moans notifies about the 
detection result. As a result, it is possible for a user to 
recognize a twist movement, an inappropriate motion of 
the body part, so that the user can easily and surely 55 
learn in what way the body part should move on the bi- 
ometric information obtaining means, verification per- 
formance and user convenience being thereby im- 



proved. 

[0029] Other objects and further features of the 
present invention will be apparent from the following de- 
tailed description when read in conjunction with the ac- 
companying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0030] 

FIG. 1 is a block diagram showing a functional con- 
struction of a biometric information obtaining appa- 
ratus according to one preferred embodiment of the 
present invention; 

FIG. 2A and FIG. 2B are views for describing be- 
ginning part of a first example of a picture image 
shown on a display of the apparatus according to 
the present embodiment: FIG. 2A illustrates how a 
finger moves with respect to a sensor surface (the 
finger's state at T seconds elapsed after it begins 
to move); FIG. 2B is a picture image generated as 
the finger moves as illustrated in FIG. 2A; 
FIG. 3A and FIG. 3B are views for describing the 
following part of tho first example imago subse- 
quently shown on the display: FIG. 3A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger' s state at T+t seconds elapsed after 
it begins to move); FIG. 3B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 3A; 
FIG. 4A and FIG. 4B are views for describing be- 
ginning part of a second example of a picture image 
shown on the display according to the present em- 
bodiment: FIG. 4A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 
at Tseconds elapsed after it begins to move); FIG. 
4B is a picture image generated as the finger moves 
as illustrated in FIG. 4A; 

FIG. 5A and FIG. 5B are views for describing the 
following part of the second example image subse- 
quently shown on the display: FIG. 5A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger's state at T+t seconds elapsed after 
it begins to move); FIG. 5B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 5A; 
FIG. 6A and FIG. 6B are picture images each for 
use, in a third example of a picture image according 
to the present invention, as an arbitrary picture im- 
age by which a finger's movement is indicated; 
FIG. 7A and FIG . 7B are views for describing be- 
ginning part of the third example picture image 
shown on the display according to the present em- 
bodiment: FIG. 7A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 
at Tseconds elapsed after it begins to move); FIG. 
7B is a picture image generated as the finger moves 
as illustrated in FIG. 7A; 

FIG. 8A and FIG. 8B are views for describing the 
following part of the third example image subse- 
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quently shown on the display: FIG. 8A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger's state at T+t seconds elapsed after 
it begins to move); FIG. 8B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 8A; 5 
FIG. 9 is a picture image for use, in a fourth example 
of a picture image according to the present inven- 
tion, as an arbitrary picture image by which a finger" 
s movement is indicated; 

FIG. 1 0A and FIG. 1 0B are views for describing be- 10 
ginning part of the fourth example picture image 
shown on the display according to the present em- 
bodiment: FIG. 10A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 
at Tseconds elapsed after it begins to move); FIG. is 
10B is a picture image generated as the finger 
moves as illustrated in FIG. 10A; 
FIG, 1 1 A and FIG. 1 1 B are views for describing the 
following part of the fourth example image subse- 
quently shown on the display: FIG. 11 A illustrates 20 
how the finger moves with respect to a sensor sur- 
face (the finger's state at T+t seconds elapsed after 
it begins to move); FIG. 1 1 B is a picture image gen- 
crated as the finger moves as illustrated in FIG. 
11A; 25 
FIG. 1 2A and FIG. 1 2B are views for describing be- 
ginning part of a fifth example of a picture image 
shown on the display according to the present em- 
bodiment: FIG. 12A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 30 
at Tseconds elapsed after it begins to move); FIG. 
12B is a picture image generated as the finger 
moves as illustrated in FIG. 12A; 
FIG. 1 3A and FIG. 1 3B are views for describing the 
following part of the fifth example image subse- 35 
quently shown on the display: FIG. 13A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger* s state at T+t seconds elapsed after 
it begins to move) ; FIG. 1 3B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 40 
13A; 

FIG. 14Aand FIG. 14B are views for describing be- 
ginning part of a sixth example of a picture image 
shown on the display according to the present em- 
bodiment: FIG. 14A illustrates how a finger moves 45 
with respect to a sensor surface (the finger's state 
at Tseconds elapsed after it begins to move); FIG. 
14B is a picture image generated as the finger 
moves as illustrated in FIG. 14A; 

FIG. 1 5A and FIG. 1 5B are views for describing the so 
following part of the sixth example of a picture im- 
age subsequently shown on the display: FIG. 15A 
illustrates how the finger moves with respect to a 
sensor surface (the finger's state at T+t seconds 
elapsed after it begins to move) ; FIG. 1 5B is a pic- 55 
ture image generated as the finger moves as illus- 
trated in FIG. 15A; 

FIG. 1 6A and FIG. 1 6B are views for describing be- 



ginning part of a seventh example of a picture image 
shown on the display according to the present em- 
bodiment: FIG. 16A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 
at Tseconds elapsed after it begins to move); FIG. 
16B is a picture image generated as the finger 
moves as illustrated in FIG. 16A; 
FIG. 17Aand FIG. 17B are views for describing the 
following part of the seventh example image subse- 
quently shown on the display: FIG. 17A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger's state at T+t seconds elapsed after 
it begins to move); FIG. 1 7B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 
17A; 

FIG. 1 8A and FIG. 1 8B are views for describing be- 
ginning part of an eighth example of a picture image 
shown on the display according to the present em- 
bodiment: FIG. 18A illustrates how a finger moves 
with respect to a sensor surface (the finger's state 
at T seconds elapsed after it begins to move); FIG. 
18B is a picture image generated as the finger 
moves as illustrated in FIG. 18A; 
FIG. 1 9A and FIG . 1 9B arc views for describing the 
following part of the eighth example image subse- 
quently shown on the display: FIG. 19A illustrates 
how the finger moves with respect to a sensor sur- 
face (the finger* s state at T+t seconds elapsed after 
it begins to move); FIG. 1 9B is a picture image gen- 
erated as the finger moves as illustrated in FIG. 
19A; 

FIG. 20 is a flowchart showing procedures of de- 
tecting a movement amount of a finger and also pro- 
cedures of absorbing a detection error according to 
the present embodiment; 

FIG. 21 is a flowchart showing procedures of de- 
tecting a movement amount of a finger and also pro- 
cedures of detecting a movement direction variation 
according to the present embodiment; 
FIG. 22A and FIG. 22B are views for describing a 
movement detection error; 

FIG. 23A and FIG. 23B are views each for describ- 
ing problems caused by movement detection er- 
rors; 

FIG. 24A and FIG. 24B are views each for describ- 
ing problems caused by movement detection er- 
rors; 

FIG. 25A through FIG. 25C are views for describing 
detection error absorption performed by a move- 
ment amount detecting means according to the 
present embodiment; 

FIG. 26A through FIG. 26C are views for describing 
partial images obtained when a finger changes the 
direction in which it moves; 

FIG. 27A and FIG. 27B are views for describing pro- 
cedures of detecting a movement amount and an 
angular displacement (movement direction varia- 
tion) of a finger when it changes the direction in 
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which it moves; 

FIG. 28A and FIG. 28B are views for describing a 
technique for reducing a load of the angular dis- 
placement detection; 

FIG. 29 is a view for describing a technique for im- 
proving the accuracy of the angular displacement 
detection; 

FIG. 30A through FIG. 30C are views for describing 
the maximum of movement velocity allowed accord- 
ing to the present embodiment; 
FIG. 31 is a view for describing twist detection per- 
formed according to the present embodiment; 
FIG. 32A is a view for describing how a finger should 
be laid on the sensor surface of a flat type fingerprint 
sensor; and 

FIG. 32B is an example of a fingerprint image ob- 
tained by the flat type fingerprint sensor. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

[0031] One preferred embodiment of the present in- 
vention is described hereinbelow with reference to the 
relevant accompanying drawings. 

[1] Construction of a biometric information obtaining 
apparatus of one preferred embodiment: 

[0032] FIG. 1 is a block diagram depicting a functional 
construction of a biometric information obtaining appa- 
ratus according to one preferred embodiment of the 
present invention. As shown in FIG. 1 , the biometric in- 
formation obtaining apparatus is realized, for example, 
by a personal computer (PC) main frame 20 equipped 
with a sweep-type fingerprint sensor 10 and a display 
30. 

[0033] Here, the sweep-type fingerprint sensor (bio- 
metric information obtaining means) 10 reads a finger- 
print from a finger (body part; see reference character 
101 in FIG. 2 through FIG. 5), while the finger 101 is 
moving relative to the sensor 10, to obtain the data 
thereof. The sweep-type fingerprint sensor 10 succes- 
sively obtains a series of partial images of the fingerprint 
of the finger 101 as biometric information. As has al- 
ready been described, this sweep-type fingerprint sen- 
sor 1 0 has a small-sized rectangular sensor surface (im- 
age obtaining surface; see reference character 11 in 
FIG. 2 through FIG. 5) whose length is sufficiently short- 
er than that of the finger 101. The fingerprint sensor 1 0 
successively obtains partial images of the finger 101 
while it is moving with respect to the sensor surface 1 1 
or while tho sensor surface 11 (fingerprint sensor 10) is 
moving with respect to the finger 101. The PC main 
frame 20 reconstructs an entire image of the finger 1 01 
from the partial images and then extracts therefrom mi- 
nutiae (branching and endpoints of fingerprint ridges) of 
the fingerprint. Alternatively, the PC main frame 20 ex- 
tracts the minutiae from the partial fingerprint images 



without reconstructing such an entire image. The thus 
extracted fingerprint information is utilized for user au- 
thentication. 

[0034] Here, when the present apparatus is applied 
5 in user authentication , the fingerprint sensor 1 0 obtains 
a series of partial images of a user* s fingerprint at the 
time user registration and user verification are per- 
formed. In the former case, the fingerprint is obtained, 
as registration biometric information, from a user's fin- 
io ger 1 01 who is previously registered as a registered us- 
er; in the latter case, a fingerprint is obtained, as verifi- 
cation biometric information, from a user who is to be 
verified at the user authentication. The thus-obtained 
registration biometric information and verification bio- 

'5 metric information are compared with each other for 
identifying the user. In addition, when the present appa- 
ratus is used to learn how a finger 101 should slide on 
a sweep-type fingerprint sensor 1 0, the fingerprint sen- 
sor 1 0 obtains a series of partial images of a fingerprint 

20 from a learner' s finger 1 01 . 

[0035] The display 30 has, for example, an LCD (Liq- 
uid Crystal Display) or a CRT (Cathode Ray Tube) to 
display various types of information thereon. In the 
present embodiment, the display 30 servos as a display 

25 means for showing thereon images (arbitrary patterns) 
generated by an image generating means 206 (de- 
scribed later). 

[0036] The PC main frame 20 functions as a move- 
ment amount detecting means 201 , velocity detecting 

30 means 202, position detecting means203,movementdi- 
rection variation detecting means 204, direction detect- 
ing means 205, image generating means 206, evaluat- 
ing means 207, sideways deviation detecting means 
208, serpentine movement detecting means 209, twist 

35 detecting means 21 0, and notifying means 211, thereby 
realizing functions of a biometric information obtaining 
apparatus of the present invention. These functions are 
realized by a CPU (Central Processing Unit) forming the 
PC main frame 20. 

40 [0037] The movement amount detecting means 201 
detects an amount of movement (positional change 
amount) of the finger 101 in two directions (the x- and 
y-directions) for a time interval At at which the fingerprint 
sensor 1 0 obtains the partial images, based on a relative 

45 positional relationship between two partial images suc- 
cessively obtained by the fingerprint sensor 10. Note 
that the y-direclion is a main movement direction (the 
direction in which a shorter side of a rectangular sensor 
surface 1 1 extends) in which a user is expected to move 

50 his finger 1 01 with respect to the fingerprint sensor 1 0, 
and also, note that the x-direction is a direction perpen- 
dicular to the main movement direction (that is, the di- 
rection in which a longer side of the rectangular sensor 
surface 11 extends). 

55 [0038] Further, the movement amount detecting 
means 201 of the present embodiment also has a func- 
tion of absorbing detection errors. If the movement 
amount detected by the movement amount detecting 
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means 201 is within a predetermined range of detection 
errors, the movement amount detecting means 201 
holds the former one of the two partial images that are 
used for detecting the movement amount, as a refer- 
ence image, without performing updating thereon, and 
repeats the movement amount detection between the 
reference image and an individual image newly ob- 
tained, until the movement amount therebetween ex- 
ceeds the predetermined range of detection errors. In 
other words, no updating is performed on the one of the 
two partial images which serves as a reference image, 
as long as the detected movement amount stays within 
the predetermined range of detection errors. As a result, 
detection errors of the movement amount are success- 
fully absorbed, as will be detailed later referring to FIG. 
20 and FIG. 22 through FIG. 25. 

[0039] The velocity detecting means 202 detects a 
movement velocity at which the finger 101 moves with 
respect lo the fingerprint sensor 10, by computation 
thereof based on a movement amount of the finger 1 01 
detected by the movement amount detecting means 
201 and an image-obtaining time interval At. 
[0040] The position detecting means 203 accumu- 
lates such movement amounts of the finger 1 01 , detect- 
ed by the movement amount detecting means 201 , in 
the x-direction and the y-direction separately; that is, 
every time the movement amount detecting means 201 
detects a movement amount (positional change 
amount) of the finger 101 , the position detecting means 
203 calculates a sum of the amounts of movement made 
so far by the finger 101 in the x-direction and the y-di- 
rection separately, thereby detecting a positional 
change (a position of the finger 101 in relation to the 
start point from which the finger 1 01 starts to move) of 
the finger 101 in both directions. 
[0041] The movement direction variation detecting 
means 204 detects a movement direction variation (an- 
gular displacement) of the finger 1 01 for a time interval 
At at which the fingerprint sensor 10 obtains the partial 
images, based on a relative positional relationship be- 
tween two partial images successively obtained by the 
fingerprint sensor 10. 

[0042] In addition, like the movement amount detect- 
ingmeans 201 , the movement direction variation detect- 
ing means 204 has a function of absorbing detection er- 
rors. If the movement direction variation detected by the 
movement direction variation detecting means 204 is 
within a predetermined range of detection errors, the 
movement direction variation detecting means 204 
holds the former one of the two partial images that are 
used for detecting the movement direction variation, as 
a reference image, without performing updating there- 
on, and repeats the movement direction variation detec- 
tion between the reference image and an individual im- 
age newly obtained, until the movement amount there- 
between exceeds the predetermined range of detection 
errors. In other words, no updating is performed on the 
one of the two partial images which serves as a refer- 
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ence image, as long as the detected movement direc- 
tion variation stays within the predetermined range of 
detection errors. As a result, detection errors of the 
movement direction variation are successfully ab- 
5 sorbed. 

[0043] In the present embodiment, detection of a 
movement direction variation of the finger 101 by the 
movement direction variation detecting means 204 is 
performed after detection of a movement amount of the 
10 finger 101 by the movement amount detecting means 
201 . More specifically, as will be described later refer- 
ring to FIG. 21, FIG. 26, and FIG. 27, the movement 
amount detecting means 201 detects a movement 
amount before the movement direction variation detect- 
15 ing means 204 detects a movement direction variation 
(angular displacement) at a position (area) where the 
two partial images overlap each other. 
[0044] The direction detecting means 205 accumu- 
lates such movement direction variations of the finger 
101 s detected by the movement direction variation de- 
tecting means 204; that is, every time the movement di- 
rection variation detecting means 204 detects a move- 
ment direction variation (angular displacement) of the 
finger 1 01 , the direction detecting moans 205 calculates 
a sum of the movement direction variations detected so 
far, thereby detecting a movement direction change (an 
angle of the finger 101 with respect to the direction in 
which the finger 101 moves when it starts to move). 
[0045] The image generatingmeans 206 generates 
an arbitrary pattern, of which a portion corresponding to 
a position at which the finger 101 (fingerprint) locates 
when the movement velocity is detected is changed in 
position and size in accordance with the detected move- 
ment velocities. The thus generated arbitrary pattern is 
then shown on the display 30. At that time, if the velocity 
detecting means 202 detects a movement velocity (the 
movement velocity in the main movement direction, or 
the y-direction) exceeding the velocity detection errors 
of the velocity detecting means 202, the image gener- 
ating means 206 updates the aforementioned arbitrary 
pattern in such a manner that the portion corresponding 
to a position at which the finger 1 01 (fingerprint) locates 
when the above velocity is detected, is changed in po- 
sition and size. Exemplary picture images generated, as 
an arbitrary pattern, on the display 30 by the image gen- 
eratingmeans 206 will be detailed later referring to FIG. 
2 through FIG. 19. 

[0046] The evaluating means 207 evaluates whether 
or not the velocity in the y-direction detected by the ve- 
locity detecting means 202 is within a range of allowable 
velocities whose maximum and minimum limits are de- 
termined (in such a manner as will be described later) 
based on properties of the fingerprint sensor 1 0 (that is, 
it is evaluated whether or not the velocity exceeds the 
maximum limit of the range, or whether or not the veloc- 
ity is less than the minimum limit). 
[0047] Hereinbelow, the maximum limit of a move- 
ment velocity according to the present embodiment will 
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be described referring to FIG. 30A through FIG. 30C. 
[0048] At detecting an amount of movement made by 
the finger 101 during an image-obtaining time interval 
At, the movement amount detecting means 201 needs 
to detect a relative positional relationship between two 5 
partial images obtained from the finger 1 01 . This relative 
positional relationship is detected by superposing one 
of the partial images on the other in such a manner that 
image overlap areas, whose picture images are identi- 
cal with each other, of the two partial images coincide. 10 
Here f such image overlap areas need to have a certain 
amount of size to realize this superposing. 5 min is a min- 
imum of the size (length) in the y-direction of an image 
overlap area required to realize the superposing (or re- 
quired to detect a movement velocity by the velocity de- is 
tecting means 202). 

[0049] For example, as shown in FIG. 30A, if the size 
(length) 6 In the y-direction of the image overlap areas 
of the two partial images is equal to the minimum overlap 
size Smin or larger, the image overlap areas are large 20 
enough to overlap image information thereof so that a 
relative positional relationship between the two partial 
images can be detected with reliability. On the other 
hand, if the overlap size 8 in the y-dircction drops below 
the minimum overlap size 8 mjn because the finger 1 01 25 
moves too fast (see FIG. 30B), or if there is no overlap 
area between the two partial images (see FIG. 30C), it 
is impossible to overlap image information of image 
overlap areas of the two partial images, thereby making 
it also impossible to detect a relative positional relation- 30 
ship between the two partial images, so that movement 
velocity of the finger 101 cannot be detected. 
[0050] Accordingly, the maximum limit of the move- 
ment velocity of the finger 1 01 is given by 

35 

«S - S mjn ) / At)* R /(((S - 5 min ) I At) + R) 

based on the following properties of the fingerprint sen- 
sor 1 0: the size S (the length in the y-direction) of partial *o 
images obtained by the fingerprint sensor 1 0; the afore- 
mentioned minimum overlap size 5 mln ; a time interval At 
at which the fingerprint sensor 1 0 obtains the partial im- 
ages; a velocity R at which the fingerprint sensor 10 
reads image information in the y-direction. Here, if the 45 
reading velocity R is sufficiently larger than (S-d mm )/At, 
the maximum limit can be given also by (S-6 mln )/Ar 
[0051] In the meantime, provided the finger 1 01 sud- 
denly turns its direction, or provided the finger 101 re- 
peatedly stops traveling, or provided the finger 101 so 
moves too slowly to absorb detection errors of the move- 
ment amount, the evaluating means 207 detects such 
states of the finger 101 when the movement velocity in 
the y-direction detected by the velocity detecting means 
202 drops below the minimum limit. If it is detected that ss 
the finger 1 01 is in such a state, the notifying means 21 1 
instructs the user to move his finger 1 01 faster in a cer- 
tain direction (y-direction). At this time, the minimum lim- 



it of the movement velocity is given, for example, as a 
velocity (that is, a velocity of a/At) at which a movement 
amount of the finger 1 01 for an image-obtaining time in- 
terval At falls below a detection error (d, for example), 
which will be detailed later, or as a velocity revealed 
when the sign of the movement velocity is inverted (that 
is, a velocity of 0). 

[0052] The sideways deviation detecting means 208 
detects a sideways deviation of the finger 101, based 
on the absolute value of a positional change (the finger 
101*s position in the x-direction in relation to the move- 
ment start point) in the x-direction (the direction which 
extends along a longer side of the fingerprint sensor 1 0) 
detected by the position detecting means 203. This side- 
ways deviation detecting means 208 compares the ab- 
solute value of the positional change in the x-direction 
with a predetermined threshold that is determined 
based on an average width of finger 1 01 . If the absolute 
value of the positional change exceeds the predeter- 
mined threshold, the sideways deviation detecting 
means 208 detects an occurrence of sideways deviation 
of the finger 101. 

[0053] The serpentine movement detecting means 
209 detects serpentine movement of the finger 101, 
based on the absolute value of a positional change (the 
finger 101's position in the x-direction in relation to the 
movement start point) in the x-direction (the direction 
which extends along a longer side of the fingerprint sen- 
sor 10) detected by the position detecting means 203, 
and on the number of times the finger 1 01 reverses its 
movement direction along the x-direction. The serpen- 
tine movement detecting means 209 compares the ab- 
solute value of the positional change in the x-direction 
with a predetermined threshold that is determined 
based on an average width of finger 101 , and it also 
compares the number of times the finger 1 01 reverses 
its movement direction along the x-direction with a pre- 
determined value. If it is found that the finger 1 01 moves 
out of a predetermined width range and reverses its 
movement direction a greater number of times than is 
predetermined, the serpentine movement detecting 
means 209 detects an occurrence of serpentine move- 
ment of the finger 101. 

[0054] The twist detecting means 210 detects twist 
movement of the finger 101 as a state where two partial 
images, for use in detecting a movement velocity by the 
velocity detecting means 202, cross each other, based 
on a movement direction change (an angle formed be- 
tween the finger 101 and the movement direction when 
the finger 101 starts to move) detected by the direction 
detecting means 205. If an arbitrary line extending in the 
x-direction in one of the two partial images crosses the 
remaining one, as shown in FIG. 31 , the twist detecting 
means 210 detects an occurrence of twist movement of 
the finger 101. 

[0055] The notifying means 21 1 notifies a user of the 
following respective detection results if: 
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(11) the evaluating means 207 detects that the 
movement velocity exceeds the aforementioned 
maximum limit, or that the velocity is smaller than 
the aforementioned minimum limit (out of the fore- 
going permissible range); s 

(12) the sideways deviation detecting means 208 
detects sideways deviation of the finger 101; 

(1 3) the serpentine movement detecting means 209 
detects serpentine movement of the finger 101; and 

(14) the twist detecting means 210 detects twist 10 
movement of the finger 101. 

[0056] At that time, the notifying means 211 can use 
picture images generated by the image generating 
means 206 so as to show the above states (1 1 ) through *5 
(14) on the display 30, or alternatively, beeps sounded 
by means of a speaker or the like. 

[2] Operation of Ihe biometric information obtaining 
apparatus according to the present embodiment: 20 

[0057] An operation of a biometric information obtain- 
ing apparatus with such a construction as has been de- 
scribed above will bo described hcrcinbelow referring to 
FIG. 2 through FIG. 29. 25 

[2-1] Image generation function of the present 
embodiment: 

[0058] In a biometric information obtaining apparatus 30 
according to the present embodiment, the image gen- 
erating means 206 generates an arbitrarypattern, of 
which a portion corresponding to a position where a fin- 
ger 1 01 (fingerprint) is located when a movement veloc- 
ity is detected, is changed in position and size in accord- 35 
ance with the detected movement velocities, and the 
generated arbitrary pattern is shown on the display 30. 
As a result, it is possible to show a movement of the 
finger 1 01 with respect to a fingerprint sensor 1 0 in real 
time, so as to instruct a user how he should move his 40 
finger 101 on the sensor surface. In other words, after 
detecting the movement (velocity, positional change, di- 
rectional change, and so on) of the finger 101 , opera- 
tions for image generation and display are carried out 
in real time. 45 
[0059] Referring to FIG. 2 through FIG. 1 9, a descrip- 
tion will be made hereinbelow of an example picture im- 
age (arbitrary pattern) generated by the image generat- 
ing means 206 on the display 30. 

so 

[2-1-1] Example image 1 : 

[0060] FIG. 2A, FIG. 2B, FIG. 3A, and FIG. 3B are 
views for describing a first example of a picture image 
generated in the present embodiment. FIG. 2A illus- 55 
trates a movement of the finger 1 01 with respect to the 
sensor surface 1 1 (the finger 1 01 ' s state at T seconds 
elapsed after it begins to move); FIG. 2B shows a picture 



image generated on the display 30 as the finger 101 
moves as illustrated in FIG. 2A; FIG. 3A illustrates a 
movement of the finger 101 with respect to the sensor 
surface 1 1 (the finger 1 01 's state at T+t seconds elapsed 
after it begins to move); and FIG. 3B shows a picture 
image generated on the display 30 as the finger 101 
moves as illustrated in FIG. 3A. 
[0061] In the first example, as illustrated in FIG. 28 
and FIG. 3B, a fingerprint image, a composite image 
made up of partial images obtained by the fingerprint 
sensor 10 : is used as an arbitrary pattern. Here, note 
that the thick broken lines indicating a path on which the 
finger 101 travels will not be shown on the display 30 in 
practical applications. 

[0062] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 2A for T seconds after it 
starts to move with respect to the rectangular sensor 
surface 1 1 , on the display 30 there is shown a fingerprint 
image (see FIG. 2B) having been obtained and com- 
bined by the time point "T(seconds), as it is, without any 
amendment performed thereon according to the move- 
ment velocity. After that, if the finger 101 travels on the 
path indicated with the solid arrow in FIG. 3A : on the 
display 30 there is shown a fingerprint image (see FIG. 
3B) having been obtained and combined by the time 
point T-i-t (seconds), as it is, without any amendment 
performed thereon according to the movement velocity. 

[2-1-2] Example image 2: 

[0063] FIG. 4A, FIG. 4B, FIG. 5A, and FIG. 5B are 
views for describing a second example of a picture im- 
age generated in the present embodiment. FIG. 4A il- 
lustrates a movement of the finger 101 with respect to 
the sensor surface 11 (the finger 10V s state at Tsec- 
onds elapsed after it begins to move); FIG. 4B shows a 
picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 4A; FIG. 5A illustrates 
a movement of the finger 1 0 1 with respect to the sensor 
surface 1 1 (the finger 1 01 *s state at T+t seconds elapsed 
after it begins to move) ; and FIG. 5B shows a picture 
image generated on the display 30 as the finger 101 
moves as illustrated in FIG. 5 A. 
[0064] In the second example, as illustrated in FIG. 
4B and FIG. 5B, a grid-like pattern is employed as an 
arbitrary pattern. Assuming that the finger 101 makes 
an ideal movement with respect to the rectangular sen- 
sor surface 11 such that it moves at a constant speed, 
which is equal to or greater than the aforementioned 
minimum limit of the movement velocity and also equal 
to or smaller than the aforementioned maximum limit of 
the movement velocity, in a constant direction (the y- 
direction), shown on the display 30 is a grid-like pattern 
composed of rectangles identical in size and shape. 
Here, note that the thick broken lines indicating a path 
on which the finger 101 travels will not be shown on the 
display 30 in practical applications. 
[0065] If the finger 1 01 moves along the path indicat- 
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ed with the solid arrow in FIG. 4A for Tseconds after it 
starts to move with respect to the sensor surface 1 1 , on 
the display 30 is shown a grid-like pattern, as shown in 
FIG. 4B, of which portions corresponding to positions 
where the finger 101 (fingerprint) locates when move- 5 
ment velocity detection is performed are altered in po- 
sition and size according to movement velocities having 
been detected by the time point of Tseconds elapsed. 
After that, if the finger 101 travels on the path indicated 
with the solid arrow in FIG. 5A, on the display 30 is 10 
shown a grid-like pattern of FIG. 5B, of which portions 
corresponding to positions where the finger 1 01 (finger- 
print) locates when movement velocity detection is per- 
formed are altered in position and size according to 
movement velocities having been detected by the time 15 
point of T+t seconds elapsed. 

[2-1-3] Example image 3: 

[0066] FIG. 6A and FIG. 6B show picture images (op- 20 
eration instruction images) each for use as an arbitrary 
picture image in a third example image generated in the 
present embodiment. FIG. 7A, FIG. 73, FIG. 8A, and 
FIG. BB are views for describing the third example of a 
picture image generated based on the picture image of 25 
FIG. 6A. FIG. 7A illustrates a movement of the finger 
101 with respect to the sensor surface 11 (the finger 
101*s state at Tseconds elapsed after it begins to 
move); FIG. 7B shows a picture image generated on the 
display 30 as the finger 1 01 moves as illustrated in FIG. 30 
7A; FIG. 8A illustrates a movement of the finger 101 with 
respect to the sensor surface 11 (the finger 101's state 
at T+t seconds elapsed after it begins to move); and 
FIG. 8B shows a picture image generated on the display 
30 as the finger 101 moves as illustrated in FIG. 8A. 35 
[0067] In the third example, the arbitrary picture im- 
age (operation instruction image) as shown in FIG. 6A 
and FIG. 6B is displayed as an arbitrary pattern. These 
picture images of FIG. 6A and FIG. 6B are prepared with 
an intention to remind a user of an operation instruction 40 
(an ideal movement of the Finger 1 01 ): FIG. 6A is suit- 
able for showing a direction in which the Finger 101 
should travel; FIG. 6B is effective for showing the way 
in which the finger 1 01 should be laid on the sensor sur- 
face 11 . Assuming that the finger 101 makes an ideal 45 
movement with respect to the rectangular sensor sur- 
face 11 such thai it moves at a constant speed, which 
is equal to or greater than the aforementioned minimum 
limit of the movement velocity and also equal to or small- 
er than the aforementioned maximum limit of the move- so 
ment velocity, in a constant direction (the y-direction), 
the operation instruction image of FIG. 6A or FIG. 6B is 
shown on the display 30, as it is, without any deforma- 
tion or displacement thereof. Here, a description will be 
made, using the operation instruction image of FIG. 6A. 55 
[0068] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 7A for Tseconds after it 
starts to move with respect to the sensor surface 1 1 , on 
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the display 30 is shown an operation instruction image, 
as shown in FIG. 7B, of which portions corresponding 
to positions where the finger 101 (fingerprint) locates 
when movement velocity detection is performed are al- 
tered in position and size according to movement veloc- 
ities having been detected by the time point of Tseconds 
elapsed. After that, if the finger 101 travels on the path 
indicated with the solid arrow in FIG. 8A, on the display 
30 is shown an operation instruction image of FIG. 8B, 
of which portions corresponding to positions where the 
finger 101 (fingerprint) locates when movement velocity 
detection is performed are altered in position and size 
according to movement velocities having been detected 
by the time point of T+t seconds elapsed. Here, note 
that the thick broken lines in FIG. 7B and FIG. 8B indi- 
cating a path on which the finger 101 travels will not be 
shown on the display 30 in practical applications. 

[2-1-4] Example image 4: 

[0069] FIG. 9 shows a picture image (character im- 
age) for use as an arbitrary picture image in a fourth 
example image generated in the present embodiment. 
FIG. 10A, FIG. 10B, FIG. 11 A, and FIG. 11 B arc views 
for describing the fourth example of a picture image gen- 
erated based on the picture image of FIG. 9. FIG. 10A 
illustrates a movement of the finger 1 01 with respect to 
the sensor surface 11 (the finger 10V s state at T sec- 
onds elapsed after it begins to move) ; FIG. 1 0B shows 
a picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 10A; FIG. 11 A illustrates 
a movement of the finger 101 with respect to the sensor 
surface 11 (the finger 1 01 's state at T+t seconds elapsed 
after it begins to move); and FIG. 11 B shows a picture 
image generated on the display 30 as the finger 101 
moves as illustrated in FIG. 11 A. 
[0070] In the fourth example, the arbitrary picture im- 
age (character image) as shown in FIG. 9, for example, 
is displayed as an arbitrary pattern. Here, the picture 
images of FIG. 9 are prepared to encourage a user to 
move his finger 101 in an ideal way. Assuming that the 
finger 101 makes an ideal movement with respect to the 
rectangular sensor surface 11 such that it moves at a 
constant speed, which is equal to or greater than the 
aforementionedminimum limit of the movement velocity 
and also equal to or smaller than the aforementioned 
maximum limit of the movement velocity, in a constant 
direction (the y-direction) , the character image of FIG. 
9 is shown on the display 30, as it is, without any defor- 
mation or displacement thereof. 

[0071] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 10A for Tseconds after 
it starts to move with respect to the sensor surface 11 , 
on the display 30 is shown a character image, as shown 
in FIG. 10B, of which portions corresponding to posi- 
tions where the finger 101 (fingerprint) is located when 
movement velocity detection is performed are altered in 
position and size according to movement velocities hav- 
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ing been detected by the time point of T seconds 
elapsed. After that, if the finger 101 travels on the path 
indicated with the solid arrow in FIG. 1 1 A, on the display 
30 is shown a character image of FIG. 11 B, of which 
portions corresponding to positions where the finger 1 01 
(fingerprint) is located when movement velocity detec- 
tion is performed are altered in position and size accord- 
ing to movement velocities having been detected by the 
time point of T+t seconds elapsed. Here, note that the 
thick broken lines in FIG. 1 0B and FIG. 1 1 B indicating a 
path on which the finger 101 travels will not be shown 
on the display 30 in practical applications. 

[2-1-5] Example image 5: 

[0072] FIG. 12A, FIG. 12B, FIG. 13A, and FIG. 13B 
are views for describing a fifth example of a picture im- 
age generated in the present embodiment. FIG. 12A il- 
lustrates a movement of the finger 1 01 with respect to 
the sensor surface 11 (the finger 10V s state at Tsec- 
onds elapsed after it begins to move); FIG. 12B shows 
a picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 12A; FIG. 13A illus- 
trates a movement of the finger 1 01 with respect to the 
sensor surface 1 1 (the finger 1 01 's state at Tit seconds 
elapsed after it begins to move); and FIG. 1 3B shows a 
picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 13A. 
[0073] In the fifth example, as illustrated in FIG. 12B 
and FIG. 13B, a movement path (a thick solid line) on 
which the finger 101 travels is employed as an arbitrary 
pattern. Assuming that the finger 101 makes an ideal 
movement with respect to the rectangular sensor sur- 
face 11 such that it moves at a constant speed, which 
is equal to or greater than the aforementioned minimum 
limit of the movement velocity and also equal to or small- 
er than the aforementioned maximum limit of the move- 
ment velocity, in a constant direction (the y-dtrection), 
on the display 30 is shown a straight line running along 
the y-direction. Here, note that the obtained and com- 
bined fingerprint images shown in FIG. 12B and FIG. 
13B will not be shown on the display 30 in practical ap- 
plications. 

[0074] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 12A for T seconds after 
it starts to move with respect to the sensor surface 11 , 
on the display 30 is shown a movement path, as shown 
in FIG. 12B, generated according to movement veloci- 
ties having been detected by the time point of Tseconds 
elapsed. After that, if the finger 101 travels on the path 
indicated with the solid arrow in FIG. 1 3A, on the display 
30 is shown a movement path of FIG. 13B generated 
according to movement velocities having been detected 
by the time point of T+t seconds elapsed. 

[2-1-6] Example image 6: 

[0075] FIG. 14A. FIG. 14B, FIG. 15A, and FIG. 15B 



are views for describing a sixth example of a picture im- 
age generated in the present embodiment. FIG. 14A il- 
lustrates a movement of the finger 101 with respect to 
the sensor surface 11 (the finger 101' s state at Tsec- 
5 onds elapsed after it begins to move) ; FIG. 14B shows 
a picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 14A; FIG. 15A illus- 
trates a movement of the finger 1 01 with respect to the 
sensor surface 1 1 (the finger 1 01 's state at T+t seconds 
10 elapsed after it begins to move); and FIG. 15B shows a 
picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 15A. 
[0076] In the sixth example, as illustrated in FIG. 1 4B 
and FIG. 15B, vectors corresponding to movement of 
15 the finger 1 01 , or arrows (or line segments) each having 
a length corresponding to a movement velocity detected 
by the velocity detecting means 202 are employed as 
an arbitrary pattern. These arrows (or line segments) ex- 
lend in directions (directions based on detection results 
of the direction detecting means 205 can be used) that 
correspond to movement directions in which the finger 
101 moves. Assuming that the finger 101 makes an ide- 
al movement with respect to the rectangular sensor sur- 
face 11 such that it moves at a constant speed, which 
is equal to or greater than the aforementioned minimum 
limit of the movement velocity and also equal to or small- 
er than the aforementioned maximum limit of the move- 
ment velocity, in a constant direction (the y-direction), 
on the display 30 are shown arrows of an identical 
length, aligned on a single straight line that runs in the 
y-direction. Here, note that the obtained and combined 
fingerprint images shown in FIG. 14B and FIG. 15B will 
not be shown on the display 30 in practical applications. 
[0077] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 14A for Tseconds after 
it starts to move with respect to the sensor surface 11 , 
on the display 30 are shown five arrows, as shown in 
FIG. 14B, which are generated according to movement 
velocities having been detected by the time point of T 
seconds elapsed and are placed at positions on the dis- 
play 30 which correspond to positions where the finger 
101 (fingerprint) is located when the movement veloci- 
ties are detected. After that, if the finger 101 travels on 
the path indicated with the solid arrow in FIG. 15A, on 
the display 30 are shown eight arrows of FIG, 15B, 
which are generated according to movement velocities 
having been delected by the lime point of T+l seconds 
elapsed and are placed at positions on the display 30 
which correspond to positions where the finger 1 01 (fin- 
gerprint) is located when the movement velocities are 
detected. 

[2-1-7] Example image 7: 

[0078] FIG. 16A, FIG. 16B, FIG. 17A, and FIG. 17B 
are views for describing a seventh example of a picture 
image generatedinthepresentembodiment. FIG. 16A il- 
lustrates a movement of the finger 101 with respect to 
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the sensor surface 11 (the finger 101's state at T sec- 
onds elapsed after It begins to move); FIG. 16B shows 
a picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 16A; FIG. 17A illus- 
trates a movement of the finger 1 01 with respect to the 
sensor surface 1 1 (the finger 101 's state at T+t seconds 
elapsed after it begins to move) ; andFIG. 1 7B shows a 
picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 17A. 
[0079] In the seventh example, as illustrated in FIG. 
1 6B and FIG. 1 7B, arrows (or line segments) each given 
a color (indicated as solid arrows and outlined arrows in 
the drawings) corresponding to a movement velocity de- 
tected by the velocity detecting means 202 are em- 
ployed as an arbitrary pattern. These arrows (or line 
segments) extend in directions (directions based on de- 
tection results of the direction detecting means 205 can 
be used) that correspond to movement directions in 
which the finger 101 moves. Assuming lhal the finger 
1 01 makes an ideal movement with respect to the rec- 
tangular sensor surface 11 such that it moves at a con- 
stant speed, which is equal to or greater than the afore- 
mentioned minimum limit of the movement velocity and 
also equal to or smaller than the aforementioned maxi- 
mum limit of the movement velocity, in a constant direc- 
tion (the y-direction) , on the display 30 are shown arrows 
of an identical color, aligned on a single straight line that 
runs in the y-direction. Here, note that the obtained and 
combined fingerprint images shown in FIG. 16B and 
FIG. 1 7B will not be shown on the display 30 in practical 
applications. 

[0080] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 16A for T seconds after 
it starts to move with respect to the sensor surface 11 , 
on the display 30 are shown five arrows, as shown in 
FIG. 16B, which are generated according to movement 
velocities having been detected by the time point of T 
seconds elapsed and are placed at positions on the dis- 
play 30 which correspond to positions where the finger 
101 (fingerprint) is located when the movement veloci- 
ties are detected. After that, if the finger 101 travels on 
the path indicated with the solid arrow in FIG. 17A, on 
the display 30 are shown eight arrows of FIG. 17B, 
which are generated according to movement velocities 
having been detected by the time point of T+t seconds 
elapsed and are placed at positions on the display 30 
which correspond lo positions where the finger 101 (fin- 
gerprint) is located when the movement velocities are 
detected. Here, note that, in FIG. 1 6B and FIG. 1 7B, the 
outlined arrows indicate velocities larger than those in- 
dicted by the solid lines. 

[2-1-8] Example image 8: 

[0081] FIG. 18A, FIG. 18B, FIG. 19A, and FIG. 19B 
are views for describing an eighth example of a picture 
image generated in the present embodiment. FIG. 18A 
illustrates a movement of the finger 101 with respect to 



the sensor surface 11 (the finger 101's state at T sec- 
onds elapsed after it begins to move); FIG. 18B shows 
a picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 18A; FIG. 19A illus- 
5 trates a movement of the finger 101 with respect to the 
sensor surface 1 1 (the finger 1 01 's state at T+t seconds 
elapsed after it begins to move) ; andFIG. 19B shows a 
picture image generated on the display 30 as the finger 
101 moves as illustrated in FIG. 19A. 
10 [0082] In the eighth example, as illustrated in FIG. 
18B and FIG. 19B, arrows (or line segments) each hav- 
ing a thickness corresponding to a movement velocity 
detected by the velocity detecting means 202 are em- 
ployed as an arbitrary pattern. These arrows (or line 

*5 segments) extend in directions (directions based on de- 
tection results of the direction detecting means 205 can 
be used) that correspond to movement directions in 
which the finger 101 moves. Assuming that the finger 
101 makes an ideal movement with respect to the rec- 

20 tangular sensor surface 1 1 such that it moves at a con- 
stant speed, which is equal to or greater than the afore- 
mentioned minimum limit of the movement velocity and 
also equal to or smaller than the aforementioned maxi- 
mum limit of the movement velocity, in a constant direc- 
ts tion (the y-direction), on the display 30 are shown arrows 
of an identical thickness, aligned on a single straight line 
that runs in the y-direction. Here, note that the obtained 
and combined fingerprint images shown in FIG. 18Band 
FIG. 1 9B will not be shown on the display 30 in practical 

30 applications. 

[0083] If the finger 1 01 moves along the path indicat- 
ed with the solid arrow in FIG. 18A for Tseconds after 
it starts tomove with respect to the sensor surface 11 , 
on the display 30 are shown five arrows, as shown in 

35 FIG. 1 8B, which are generated according to movement 
velocities having been detected by the time point of 7 
seconds elapsed and are placed at positions on the dis- 
play 30 which correspond to positions where the finger 
101 (fingerprint) is located when the movement veloci- 

40 ties are detected. After that, if the finger 1 01 travels on 
the path indicated with the solid arrow in FIG. 19A, on 
the display 30 are shown eight arrows of FIG. 19B, 
which are generated according to movement velocities 
having been detected by the time point of T+t seconds 

45 elapsed and are placed at positions on the display 30 
which correspond to positions where the finger 101 (fin- 
gerprint) is located when the movement velocities are 
detected. 

50 [2-2] Notification function of the present embodiment: 

[0084] In a biometric information obtaining apparatus 
according to the present embodiment, if it is found that 
a user moves his finger 1 01 in such a manner that ver- 
55 jf ication performance of the apparatus is lowered (an in- 
appropriate movement of the finger 101), the notifying 
means 211 notifies the user to that effect in real time. 
[0085] As such verification-performance-lowering 
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movement is performed by the finger 101 , the following 
are detected: 

(21 ) a movement velocity of the finger 1 01 exceed- 
ing a detection limit (a movement velocity out of the 
aforementioned permissible range of velocities); 

(22) a significant sideways deviation of the finger 
101; 

(23) a significant serpentine movement of the finger 
101 in a lateral direction; and 

(24) a twist movement of the finger 1 01 . 

[0086] Thesemotions (21 ), (22), (23), and (24) of the 
finger 101 are detected by the evaluating means 207, 
sideways deviation detecting means 208, serpentine 
movement detecting means 209, and twist detecting 
means 210, respectively. Upon detection of these mo- 
tions (21 ) through (24), the notifying means 21 1 notifies 
Ihe user thai he is moving his finger 101 in an inappro- 
priate way, and also in what way the movement is inap- 
propriate (for example, the finger 1 01 moves too fast or 
too slow; it slides sideways significantly; it serpentines 
significantly; it shows a twisted motion). Such notifica- 
tion is given, for example, as a picture image shown on 
the display 30 together with beeps sounded by a speak- 
er or the like. 

[2-3] Movement amount detection and detection error 
absorption in the present embodiment: 

[0087] Referring now to the flowchart (step S11 
through step S17) of FIG. 20, a description will be made 
hereinbelow on procedures of movement amount detec- 
tion and detection error absorption performed by the 
movement amount detecting means 201. The finger- 
print sensor 1 0 obtains the first image (a partial image) 
of the fingerprint of the finger 1 01 (step S11 ), which im- 
age is then set as a reference image for use in detecting 
an amount of movement of the finger 101 (step S12). 
After that, the fingerprint sensor 10 obtains the Nth (the 
initial value of N is 2; A*= 2, 3, 4, ..,) fingerprint image 
(partial image) (step S1 3) , and the Nth fingerprint image 
and the reference image overlap each other, thereby 
producing an overlap area to detect a relative positional 
relationship therebetween, based on which the amount 
of movement between the reference image and the Nth 
fingerprint image is then detected (step S14). After thai, 
it is detected whether or not the detected movement 
amount (the amount in the y-direction in the present ex- 
ample) exceeds a predetermined detection error (step 
S15). 

[0088] If the above detection result is positive (YES 
route of step S15), the movement amount detected at 
step S1 4 is output, as a detection result, from the move- 
ment amount detecting means 201 , and the Nth finger- 
print image obtained at step S13 is newly set as a ref- 
erence image for use in detecting another movement 
amount, thereby updating the reference image (step 



S16). A/is. incremented by M 1 M (step S17), and the proc- 
ess returns to step S13. 

[0089] On the other hand, if the above detection result 
is negative (NO route of step S15), step S16 is skipped. 
5 N is incremented by "1" (step S17), and the process re- 
turns to step S13. That is, the current reference image 
is held, without undergoing updating thereof, to serve 
as a reference image until a movement amount exceed- 
ing the above-mentioned predetermined detection error 
io is detected at step S14. Here, the movement amount 
detected at step S14 is not output, as a detection result, 
from the movement amount detecting means 201 until 
a movement amount exceeding the above-mentioned 
predetermined detection error is detected at step S14. 
is [0090] Next, referring to FIG. 22 through FIG. 25, a 
description will be made hereinbelow of a movement 
amount detection error, problems caused by this error, 
and how the error is absorbedbymeans of a movement 
amounl delecting means according lo Ihe present em- 
bodiment. 

[0091] FIG. 22A and FIG. 22B are views for describing 
a movement amount detection error. FIG. 22A is the Nth 
image (partial image) of the fingerprint obtained from the 
finger 101 after it starts to move; FIG. 22B is the (A/i-1 ) 
th fingerprint image of the same. 

[0092] FIG. 22A and FIG. 22B show an example in 
which the amount of movement made by the finger 101 
in the main movement direction (the y-direction), from a 
position where the partial image of FIG. 22A is obtained 
to a position where the partial image of FIG. 22B is ob- 
tained, is smaller than one pixel of the picture image ob- 
tained by the fingerp rint sensor 1 0 (that is, with in a range 
of movement amount detection errors). Such a move- 
ment amount is regarded as a detection error at detect- 
ing a movement amount by the fingerprint sensor 1 0 and 
the movement amount detecting means 201 . Since the 
minimum movement amount detected by the fingerprint 
sensor 10 is one pixel of an image picture obtained by 
the fingerprint sensor 10, such a movement amount as 
small as it falls within the range of detection errors, is 
normally assumed to be either 1 or 0 pixels. 
[0093] FIG. 23A, FIG. 23B, FIG. 24A, and FIG. 24B 
are views for describing problems caused by such a 
movement amount detection error shown in FIG. 22A 
and FIG. 22B. 

[0094] In the example of FIG. 23A, such a movement 
amounl wilhin Ihe range of movement amount detection 
errors as shown in FIG. 22A and FIG. 22B, is assumed 
to be 1 pixel, and the partial images of FIG. 22A and 
FIG. 22B overlap each other. In the mean time, in the 
example of FIG. 23B, this small movement amount is 
assumed to be 0 pixels, and the partial images of FIG. 
22A and FIG. 22B overlap each other. As illustrated in 
FIG. 23A and FIG. 23B, if partial images are overlapping 
pixel on pixel, it will cause a pixel error, thereby affecting 
the overlapping accuracy. 

[0095] Further, FIG. 24A and FIG. 24B show an ex- 
ample where updating of reference images (for use in 
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detecting a movement amount) is carried out every time 
the fingerprint sensor 10 obtains a partial image of the 
finger 101 and where movement amounts smaller than 
one pixel are obtained from several successive partial 
images. Those drawings illustrate fingerprint images 
formed of the successive partial images being over- 
lapped. 

[0096] FIG. 24A illustrates an overlap image obtained 
when a state of FIG. 23A (a state where a movement 
amount within a range of detection errors is detected 
and the amount is assumed to be 1 pixel) occurs several 
times consecutively. As shown in FIG. 24A, if such a de- 
tection state occurs multiple times, the detection result 
is significantly scaled up to an amount greatly larger 
than the actual length . 

[0097] FIG. 24B illustrates an overlap image obtained 
when a state of FIG. 23B (a state where a movement 
amount within a range of detection errors is detected 
and the amount is assumed to be 0 pixels) occurs sev- 
eral times consecutively. As shown in FIG. 24B, if such 
a detection state occurs multiple times, the detection re- 
sult is significantly scaled down to an amount greatly 
smaller than the actual length. 

[0098] In this manner, if a movement amount within a 
range of detection errors is repeatedly detected, detec- 
tion errors are accumulated, thereby greatly increasing 
a movement amount error, so that the verification rate 
will be deteriorated. Therefore, it is required to prevent 
the detection errors from being accumulated so that the 
movement amount error is minimized. 
[0099] FIG. 25A through FIG. 25C are views for de- 
scribing processing performed by the movement 
amount detecting means 201 for absorbing a detection 
error. Here, a description will be made on an assumption 
that a predetermined detection error is d pixels. 
[0100] FIG. 25A and FIG. 25B show the same states 
as those shown in FIG. 22A and FIG. 22B, respectively. 
In the present embodiment, if a movement amount with- 
in a predetermined range (smaller than d pixels) of er- 
rors is repeatedly detected : the Nth partial image of FIG. 
25A is kept/held as a reference image without undergo- 
ing updating thereof. Then, as shown in FIG. 25C, if a 
y-direction movement amount between the Nth (refer- 
ence image) and the (N+K)th partial images exceeds 
the predetermined error range (that is, a y-direction 
movement amount of the finger 101 exceeds d pixels; 
YES route of step S15), the result of the movement 
amount detection is output, and the reference image is 
updated (replaced with the (N+K)th partial image). 
[0101] With this feature, even if movement amounts 
within a range of detection errors are consecutively de- 
tected, the detection errors arc absorbed without being 
accumulated so that the effects of such detection errors 
can be minimized. In the example of FIG. 25A through 
FIG. 25C, the (N+1 )th through the (N+K-1 )th images, in 
which the movement amounts are smaller than d pixels, 
are discarded so that such a process as of updating ref- 
erence images can be skipped, thereby shortening 



processing time. 

[2-4] Movement amount detection/movement direction 
variation detection of the present embodiment: 

5 

[0102] FIG. 21 is a flowchart (step S21 through step 
S27) showing procedures of movement amount detec- 
tion and movement direction variation detection accord- 
ing to the present embodiment. Note that, in the follow- 
10 ing description, a movement direction variation will also 
be called an angular displacement. 
[0103] As shown in FIG. 21 , the fingerprint sensor 10 
obtains the first image (a partial image) of the fingerprint 
of the finger 101 (step S21), which image is then set as 
is a reference image for use in detecting a movement 
amount and an angular displacement of the finger 101 
(step S22). After that, the fingerprint sensor 10 obtains 
the Nth (the initial value of /Vis 2; N= 2, 3, 4, ...) finger- 
print image (partial image) (step S23), and the Nth fin- 
20 gerprint image and the reference image overlap each 
other, thereby producing an overlap area to detect a rel- 
ative positional relationship therebetween, based on 
which the movement amount detecting means 201 de- 
tects an amount of movement (AX, AY) between the ref- 
erence image (the (N-1) th partial image) and the Nth 
fingerprint image is then detected (step S24). A tech- 
nique of detecting a movement amount will be detailed 
later with reference to FIG. 27A. 

[0104] Subsequently, in the vicinity of the movement 
amount detected at step S24, an angular displacement 
of the Nth partial image in relation to a reference image 
(the (N-1) th partial image, here) is detected (step S25). 
A technique of detecting the angular displacement will 
be detailed later with reference to FIG. 27B. 
[01 05] After that, the Nth partial image is set as a ref- 
erence image for use in detecting an angular displace- 
ment. More specifically, after updating the current refer- 
ence image (step S26), A/is incrementedby 1 (step S27), 
and the process returns to step S23. 
[01 06] Note that the processing of absorbing a move- 
ment amount detection error, which has already been 
described with reference to FIG. 20, is omitted in the 
flowchart of FIG. 21 . Further, the processing of detection 
error absorption, which has already been described with 
reference to FIG. 20 and FIG. 22 through FIG. 25 in a 
case where the detection error is caused at movement 
amount detection, is likewise applicable in angular dis- 
placement (movement direction variation) detection. 
With this application, like effects and benefits to those 
which are realized at movement amount detection will 
also be realized in angular displacement detection. 
[0107] Hero, FIG. 26A through FIG. 26C are views for 
describing partial images obtained when the finger 101 
changes the direction in which it moves. FIG. 26A shows 
an example where the finger 1 01 travels with respect to 
the sensor surface 11, changing the direction in which 
it moves. FIG. 26B and FIG. 26C are the Nth (reference 
image) and the (N+1) th partial images, respectively, 
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which are obtained as the finger 1 01 changes its move- 
ment direction as shown in FIG. 26A. When the finger 
101 travels as shown in FIG. 26A while changing the 
direction in which it moves, the following three types of 
quantities need to be examined: movement amounts 5 
(AX, AY) and an angular displacement AG, thereby ne- 
cessitating a greatly increased time duration for calcu- 
lation in comparison with when the finger 1 01 makes a 
simple, parallel movement. In particular, a significantly 
high load is caused by examination of a rotational direc- 10 
tion (angular displacement). 

[0108] Therefore, in the present embodiment, after a 
movement amount is roughly detected as shown in FIG. 
27 A (step S24 of FIG. 21), an angular displacement is 
detected as shown in FIG. 27B (step S25 of FIG. 21). 15 
Here, FIG. 27A and FIG. 27B are views for describing 
procedures of detecting a movement amount and an an- 
gular displacement (movement direction variation) of 
the finger 101 when it changes its movement direction 
as shown in FIG. 26A. A movement amount and an an- 20 
gular displacement are detected from the partial images 
of FIG. 26Band FIG. 26C. 

[01 09] That is, the present embodiment detects rough 
movement amounts (AX, AY) alone, as shown in FIG. 
27A, ignoring an angular displacement to reduce an 25 
amount of calculation (stepS24 of FIG. 21). If an image- 
obtaining time interval At is sufficiently short, detection 
errors of such movement amounts (AX, AY) can be re- 
garded to be also sufficiently small. After that, the (N+1) 
th partial image is moved in parallel with the Nth partial 30 
image by the movement amounts (AX, AY) detected at 
step S24, and at this position, an angular displacement 
AG of the (N+1) th partial image in relation to the Nth 
partial image is detected (step S25 of FIG . 21 ). This fea- 
ture makes it possible to detect movement of the finger 35 
101 in an efficient manner. 

[0110] Further, FIG. 28A and FIG. 28B show a tech- 
nique of thoroughly reducing the load caused by angular 
displacement detection. Generally speaking, if partial 
images are turned so as to detect an angular displace- 40 
ment therefrom, calculation processing load is resultant- 
ly increased. Thus, in order to reduce the calculation . 
load, thereby improving the real-time characteristic of 
the present apparatus, a simplified technique of angular 
displacement detection is employed in the present em- 45 
bodiment. Provided a time interval at which picture im- 
ages are obtained is sufficiently short, the angular dis- 
placement is also sufficiently minute, so that it is possi- 
ble to assume that a positional difference in the y-direc- 
tion between both x-direction ends of a partial image is so 
one pixel or several pixels at the maximum (see FIG. 
28A) . Therefore, as shown in FIG. 28B, the partial im- 
age is divided into two or more areas (two areas in FIG. 
28B) , and a movement amount (AX, AY) is detected in 
each of the divided areas. Then, if such movement 55 
amounts differ from one another, the situation is detect- 
ed as an occurrence of angular displacement. 
[0111] Here, assuming an angular displacement se- 



quentially detected is fli, a position (directional change; 
an angle of the finger 101 in relation to the direction in 
which the finger 101 travels when it starts to move) of 
the finger 1 01 is expressed by the sum total X6i of the 
angular displacements. The sum total XBi is calculated 
by the direction detecting means 205 as has already 
been described above. 

[0112] FIG. 29 shows a technique of improving the ac- 
curacy of angular displacement detection according to 
the present embodiment. The simplified method of de- 
tecting an angular displacement, which has already 
been described with reference to FIG. 28A and FIG. 
28B : has a problem in that the detection error becomes 
significantly large as in the case of movement amount 
detection, which has already been described with refer- 
ence to FIG. 27A. For the purpose of reducing the de- 
tection error, after dividing a partial image into two or 
more (four in FIG. 29) areas, the mean value of the an- 
gular displacements obtained from these areas is used 
as an angular displacement of the partial image. Alter- 
natively, if the movement amounts detected in each di- 
vided area are smaller than a predetermined value, it is 
considered that no angular displacement occurs, so that 
no updating is performed on the current reference image 
as in the case of absorbing a movement detection error. 
In this manner, dividing a partial image into two or more 
areas so as to perform detection processing therein, is 
effective in reducing a detection error as well as in ab- 
sorbing effects caused by a distorted outer skin of the 
finger 101 . 

[3] Effects and profits of the biometric information 
obtaining apparatus of the present embodiment: 

[0113] With the biometric information obtaining appa- 
ratus of the present embodiment, the velocity detecting 
means 202 detects a movement velocity of the finger 
101 in relation to the sweep-type fingerprint sensor 10, 
and the image generating means 206 generates an ar- 
bitrary pattern of which portions corresponding to a po- 
sition where the finger 101 (fingerprint) is located when 
the movement velocity is detected is altered in position 
and size according to the detected movement velocity, 
and the arbitrary pattern is shown in real time on the 
display 30 while being updated consecutively In syn- 
chronization with the finger 101 traveling on the finger- 
print sensor 10. As a result, it is possible for a user to 
be aware of a current movement of his finger 101 with 
respect to the fingerprint sensor 10 simply by referring 
to the display 30, so that the user can easily and surely 
learn in what way the finger 101 should be slid across 
the fingerprint sensor 10, thereby improving the verifi- 
cation performance of the apparatus and the conven- 
ience of users. 

[0114] At that time, as an arbitrary pattern generated 
by the image generating means 206, the present em- 
bodiment employs any one of the following (already de- 
scribed referring to FIG. 4 through FIG. 19): 
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(31 ) a grid-like pattern; 

(32) an arbitrary image (an operation instruction im- 
age or a character picture image); 

(33) a path on which the finger 101 travels; 

(34) a line segment or an arrow having a length ac- 5 
cording to a movement velocity detected by the ve- 
locity detecting means 202; 

(35) a line segment or an arrow of a color according 
to a movement velocity detected by the velocity de- 
tecting means 202; and 10 

(36) a line segment or an arrow having a thickness 
according to a movement velocity detected by the 
velocity detecting means 202, instead of a finger- 
print image (see FIG. 2 and FIG. 3) formed of partial 
images combined , which are obtained by the finger- 1 5 
print sensor 1 0. Here, the segments and the arrows 
(34) through (36) extend in directions in which the 
finger 101 moves. 

[0115] With this feature, it is possible to show such an 20 
image or a path that corresponds to and is synthesized 
with movement of the finger 101 while updating the im- 
age or the path consecutively. As a result, an inappro- 
priate movement of the finger 1 01 such as significantly 
straying from side to side, a serpentine movement, or a 25 
twist-added movement, is clearly shown on the display 
30, thereby enabling a user to recognize the inappropri- 
ate movement of his finger 1 01 simply by referring to the 
display 30, so that the user can easily and surely learn 
a correct way in which the finger 101 should be slid so 
across the fingerprint sensor 10. 
[0116] When using the above pattern (33) through 
pattern (36), in particular, which are low in data amount, 
since it is no longer required to show a fingerprint image 
which is high in data amount, and the load of image 35 
processing is thus significantly reduced, so that even 
with a system that is slow in image processing it is still 
possible to show a movement of the finger 101 in real 
time. 

[0117] Further, a graphic image (for example, the 40 
above arbitrary patterns (31) through (36)), instead of a 
fingerprint image itself, the original state (with no distor- 
tion thereof) of which a graphic image can be easily im- 
agined, is shown on the display 30. Therefore, even if 
the present invention is introduced in a desktop PC, on 45 
which such a fingerprint image tends to be easily seen 
by others, it is possible for a user to recognize a distorted 
movement of the finger 101 , without affecting security 
characteristics, that is, protecting the user's privacy. 
[0118] Furthermore, if the evaluating means 207 rec- so 
ognizes that a movement velocity detected by the ve- 
locity detecting means 202 falls out of a predetermined 
range, or if the sideways deviation detecting means 208 
detects a sideways deviation of the finger 101 , or if the 
serpentine movement detecting means 209 detects a 55 
serpentine movement of the finger 1 01 , or if the twist 
detecting means 210 detects a twist movement of the 
finger 1 01 , the notifying means 21 1 notifies the user of 



such a detection result by image information and/or 
sound information, thereby enabling a userto recognize 
an inappropriate motion of his finger 101 (for example, 
too quick a movement of the finger 101 such that the 
partial images obtained by the fingerprint sensor 10 do 
not sufficiently overlap one another, thereby making it 
impossible to detect the movement velocity and to re- 
construct the partial image into a fingerprint image; side- 
ways deviation; serpentine movement; a twist-added 
movement), so that the user can easily and surely learn 
a correct way the finger 101 should be slid across the 
fingerprint sensor 10. 

[0119] As a comparative experiment, users who had 
never operated a sweep-type fingerprint sensor 
scanned their fingers 10 times on both the present ap- 
paratus and a previous apparatus, and a rate of suc- 
cessful scanning, in which a verifiable fingerprint was 
obtained (the rate at which partial fingerprint images are 
successfully reconstructed into a fingerprint image), 
was measured. As a result, a rate of 30% was revealed 
in the previous apparatus, whereas a greatly improved 
rate of 90% was revealed in the present apparatus. This 
experiment indicates the users could recognize the 
movements of thoir fingers moro accurately on the 
present apparatus so that they could learn how to slide 
their fingers on the sweep-type fingerprint sensor with 
fewer times of practicing. 

[0120] On the other hand, according to the present 
embodiment, the movement amount detecting means 
201 detects a movement amount (AX, AY) for an image- 
obtaining time interval At, based on a relative positional 
relationship between two successive partial images ob- 
tained. On the basis of the detected movement amount 
and the image-obtaining time interval At, a movement 
velocity of the finger 101 is extremely easily obtained 
with high accuracy by the velocity detecting means 202. 
In addition, the position detecting means 203 accumu- 
lates such movement amounts of the finger 1 01 , thereby 
extremely easily detecting a positional change of the fin- 
ger 101 with high accuracy. Further, the movement di- 
rection variation detecting means 204 detects an angu- 
lar displacement AG for an image-obtaining time interval 
At, based on a relative positional relationship between 
two successive partial images obtained, and the direc- 
tion detectingmeans205 accumulates such angular dis- 
placements A6, thereby extremely easily detecting a 
movemenl direction change (an angle of the finger 101 
in relation to a movement direction in which the finger 
1 01 travels when it starts to move) of the finger 1 01 with 
high accuracy. 

[0121] At that time, if the movement amount detected 
by the movement amount detecting means 201 or the 
angular displacement detected by the movement direc- 
tion variation detecting means 204 is within a range of 
detection errors, the movement amount detecting 
means 201 or the movement direction variation detect- 
ing means 204 holds the reference image that is used 
in detection of the movement amount or the angular dis- 
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placement, without updating thereof, until a movement 
amount or an angular displacement exceeding the de- 
tection error range is detected. As a result, even if move- 
ment amounts or angular displacements smaller than a 
predetermined value are consecutively detected, the 5 
detection errors are sureiy prevented from being accu- 
mulated,theireffectsbeingtherebysuppressed. In addi- 
tion, since the current reference image is held without 
being updated, reference image-updating processing 
can be skipped, thereby shortening processing time. 10 
[0122] Further, as has already been described refer- 
ring to FIG. 21 and FIG. 27, if the image-obtaining time 
interval At is sufficiently short, it can be assumed that 
movement amount detection error is also sufficiently 
small. Therefore, after detection of a rough amount of is 
movement alone of the finger 1 01 , an angular displace- 
ment (movement direction variation) of the finger 101 is 
detected, thereby significantly reducing computation 
processing load. 

20 

[4] Others: 

[0123] The present invention should by no means be 
limited to the above- illustrated embodiment, and various 
changes or modifications may be suggested without de- 25 
parting from the gist of the invention. 
[0124] For instance, a personal computer is employed 
to realize an apparatus of the present invention, but the 
invention should by no means be limited to this and is 
also applicable in a similar manner to an apparatus ded- 30 
icated to user authentication. In this case, like effects 
and benefits to those of the above embodiment will be 
realized. 

[0125] Further, in the present embodiment, the body 
part is a finger, and biometric information obtained 35 
therefrom is a fingerprint image. The invention should 
by no means be limited to this, and the body part can 
be a palm, and biometric information obtained therefrom 
can be a palm print or a blood-vessel arrangement im- 
age or the like. In this case, also, like effects and profits 40 
to those of the above embodiment will be realized. 
[0126] Still further, a computer, such as a CPU, exe- 
cutes predetermined application programs, thereby 
functioning as a movement amount detecting means 
201 , velocity detecting means 202 5 position detecting *s 
means 203, movement direction variation detecting 
means 204, direction delecting means 205, image gen- 
erating means 206, evaluating means 207, sideways 
deviation detecting means 208, serpentine movement 
detecting means 209, twist detecting means 210, and so 
notifying means 211 (all or part of the function of the in- 
dividual means), as already described above. 
[01 27] Those programs are offered in the form of re- 
cording media, such as flexible discs, CD-ROMs, 
CD-Rs, CD-RWs ? DVDs, and so on, having such pro- 55 
grams stored thereon. In this case, a computer reads 
out the programs from the recording media, which are 
then transferred to its interna! or external storage device 



and stored therein. At that time, the programs can be 
stored in storage devices (recording media) , such as 
magnetic discs, optical discs, and magneto-optical 
discs, which programs are then offered from the storage 
devices to a computer via a communication network. 
[0128] Here, a computer is defined as a concept in- 
cluding hardware and an OS (Operating System), or 
hardware operating under control of an OS. In a case 
where an OS is not required and an application program 
by itself operates hardware, the hardware itself is equiv- 
alent to a computer. Hardware includes at least a micro- 
processor such as a CPU and a means for reading a 
program from a recording medium. The above applica- 
tion programs contain program codes that instruct a 
computer to function as a movement amount detecting 
means 201 , velocity detecting means 202, position de- 
tecting means 203, movement direction variation de- 
tecting means 204, direction detecting means 205, im- 
age generating means 206, evaluating means 207, 
sideways deviation detecting means 208, serpentine 
movement detecting means 209, twist detecting means 
210, and notifying means 211, as already described 
above. Moreover, part of such functions can be realized 
by an OS instead of application programs. 
[0129] Furthermore, as such recording media de- 
scribed above, various types of computer-readable re- 
cording media are also applicable as follows: IC cards; 
ROM cartridges; magnetic tapes; punch cards; internal 
storage devices (memories such as RAMs and ROMs) 
of a computer; external storage devices; printed media 
having any type of code, such as barcodes, printed ther- 
eon. 



Claims 

1. A biometric information obtaining apparatus, com- 
prising: 

biometric information obtaining means (10) for 
reading a Irving individual's body part during a 
relative movement between the body part and 
said biometric information obtaining means 
( 1 0) , and for obtaining a series of partial images 
of the body part as biometric information; 
velocity detecting means (202) for detecting a 
movement velocity at which the body part 
moves with respect to said biometric informa- 
^. tion obtaining means (10); 

image generating means (206) for generating 
an arbitrary pattern, of which a portion corre- 
sponding to a position whore the body part is 
located at the movement velocity detection per- 
formed is altered according to the movement 
velocity detected by said velocity detecting 
means (202); and 

a display (30) forshowing thereon said arbitrary 
pattern generated by said image generating 
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means (206). 

2. A biometric information obtaining apparatus, com- 
prising: 

biometric information obtaining means (10) for 
reading a living individual's body part during a 
relative movement between the body part and 
said biometric information obtaining means 
(10), and for obtaining a series of partial images 
of the body part as biometric information; 
velocity detecting means (202) for detecting a 
movement velocity at which the body part 
moves with respect to said biometric informa- 
tion obtaining means (10); 
evaluating means (207) for evaluating whether 
or not the movement velocity, which is detected 
by said velocity detectingmeans (202), is within 
a permissible range, which depends on a prop- 
erty of said biometric information obtaining 
means (10); and 

notifying means (211 ) for notifying, if the above 
evaluation result of said evaluating means 
(207) is negative, about the negative evaluation 
result. 

3. A biometric information obtaining apparatus as set 
forth in claim 1 , further comprising: 

evaluating means (207) for evaluating whether 
or not the movement velocity, which is detected 
by said velocity detecting means (202), is within 
a permissible range, which depends on a prop- 
erty of said biometric information obtaining 
means (10); and 

notifying means (211 ) for notifying, if the above 
evaluation result of said evaluating means 
(207) is negative, about the negative evaluation 
result. 

4. A biometric information obtaining apparatus as set 
forth in claim 2 or claim 3, wherein a maximum of 
the permissive range is determined based at least 
on the following properties of said biometric infor- 
mation obtaining means (1 0) : a size of each of the 
partial images obtained by said biometric informa- 
tion obtaining means (10) ; a minimum of overlap- 
ping between the partial images, which value is re- 
quired for detecting the movement velocity by said 
velocity detecting means (202); and a time interval 
at which such partial image is obtained by said bi- 
ometric information obtaining means (10). 

5. A biometric information obtaining apparatus as set 
forth in claim 1 or claim 3, wherein, if the velocity 
detected by said velocity detecting means (202) ex- 
ceeds a velocity detection error, said image gener- 
ating means (206) updates said arbitrary pattern in 
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such a manner that a portion thereof, corresponding 
to a position at which the body part is located when 
the movement velocity is detected, is altered. 

5 6. A biometric information obtaining apparatus as set 
forth in any one of claim 1 through claim 5. further 
comprising movement amount detecting means 
(201) for detecting, based on a relative positional 
relationship between two partial images succes- 

10 sively obtained by said biometric information ob- 
taining means (10), an amount of movement of the 
body part for a time interval at which such partial 
image is obtained by said biometric information ob- 
taining means (10), 

15 said velocity detecting means (202) calculat- 

ing said movement velocity based on the movement 
amount of the body part detected by said movement 
amount detecting means (201 ) and the time interval 
al which such partial image oblaining is performed. 

20 

7. A biometric information obtaining apparatus as set 
forth in claim 6, wherein, if the movement amount 
detected by said movement amount detecting 
means (201) is within a range of detection errors, 

25 said movement amount detecting means (201) 
holds a former one of the two partial images, which 
are used in detecting the movement amount, as a 
reference image, and newly detects such move- 
ment amount of the body part based on a relative 

30 positional relationship between said reference im- 
age and another partial image obtained subse- 
quently to a later one of the two partial images. 

8. A biometric information obtaining apparatus as set 
35 forth in claim 6 or claim 7, further comprising posi- 
tion detecting means (203) for detecting a positional 
change of the body part by accumulating such 
movement amounts detected by said movement 
amount detecting means (201). 

40 

9. A biometric information obtaining apparatus as set 
forth in claim 8, further comprising: 

sideways deviation detecting means (208) for 
45 detecting a sideways deviation of the body part 

based on the absolute value of the positional 
change, detected by said position detecting 
means (203), in a direction perpendicular to a 
main movement direction in which the body part 
50 is expected to move with respect to said bio- 

metric information obtaining means (10); and 
notifyingmcans (211) fornotifying, ifsuchside- 
ways deviation is detected by said sideways 
deviation detecting means (208), about the de- 
55 tection result. 

10. A biometric information obtaining apparatus as set 
forth in claim 8 or claim 9, further comprising: 
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serpentine movement detecting means (209) 
for detecting serpentine movement based on 
the followings: the absolute value of the posi- 
tional change, detected by said position detect- 
ing means (203), in a direction perpendicular to 
a main movement direction along which the 
body part is expected to move with respect to 
said biometric information obtaining means 
(10); and the number of times the body part re- 
verses its movement direction along the per- 
pendicular direction; and 
notifying means (211 ) for notifying, if such ser- 
pentine movement is detected by said serpen- 
tine movement detecting means (209) , about 
the detection result. 

11. A biometric information obtaining apparatus as set 
forth in any one of claim 1 through claim 1 0, further 
comprising: 

movement direction variation detecting means 
(204) for detecting, based on a relative posi- 
tional relationship between two partial images 
successively obtained by said biometric infor- 
mation obtaining means (10), a movement di- 
rection variation of the body part for a time in- 
terval at which such partial image is obtained 
by said biometric information obtaining means 
(10); and 

direction detecting means (205) for detecting a 
movement direction change of the body part by 
accumulating such movement direction varia- 
tions of the body part detected by said direc- 
tional change amount detecting means (204). 

12. A biometric information obtaining apparatus as set 
forth in claim 1 1 , wherein, if the movement direction 
variation detected by said movement direction var- 
iation detectingmeans (204) is within a range of de- 
tection errors, said movement direction variation 
detecting means (204) holds a former one of the two 
partial images, which have been used for detecting 
the movement direction variation, as a reference 
image, and newly detects such movement direction 
variation of the body part based on a relative posi- 
tional relationship between said reference image 
and another partial image obtained subsequently to 
a later one of the two partial images. 

13. A biometric information obtaining apparatus as set 
forth in claim 11 or claim 12, wherein the detection 
of such movement direction variation of the body 
part is performed after completion of the movement 
amount detection. 

14. A biometric information obtaining apparatus as set 
forth in any one of claim 1 1 through claim 1 3, further 
comprising: 



twist detecting means (210) for detecting, 
based on the movement direction change de- 
tected by said direction detecting means (205), 
twist movement of the body part as a situation 

5 where the two partial images, for use in detect- 

ing the movement velocity by said velocity de- 
tecting means (202), cross each other; and 
notifying means (211) for notifying, if such twist 
movement of the body part is detected by said 

10 notifying means (211), about the detection re- 

sult. 

15. A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 

*5 bitrary pattern generated by said image generating 
means (206) is a picture image of the body part that 
is made by combining said series of partial images 
of the body part obtained by said biometric informa- 
tion obtaining means (10). 

20 

16. A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5 } wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is a grid-like pattern. 

25 

17. A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is an arbitrary picture image. 

30 

18. A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is a path along which the body part 

35 moves. 

19. A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is a line segment or an arrow having 
a length according to the movement velocity detect- 
ed by said velocity detecting means (202). 

A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is a line segment or an arrow of a color 
corresponding to the movement velocity detected 
by said velocity detecting means (202). 

A biometric information obtaining apparatus as set 
forth in claim 1 , claim 3, or claim 5, wherein the ar- 
bitrary pattern generated by said image generating 
means (206) is a line segment or an arrow having 
a thickness according to the movement velocity de- 
tected by said velocity detecting means (202). 

22. A biometric information obtaining apparatus as set 
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forth in any one of claim 1 9 through claim 2 1 , where- 
in the line segment and the arrow, generated by said 
image generating means (206), extend in a direc- 
tion that corresponds to a movement direction of the 
body part. 5 

23. A biometric information obtaining apparatus as set 
forth in any one of claim 1 through claim 22, wherein 
said biometric information obtaining means (1 0) ob- 
tains such series of partial images of the body part 10 
as registration biometric information, which is pre- 
viously registered for use in user authentication, 
said registration biometric information being com- 
pared, forverification, with verification biometric in- 
formation, which is obtained from a user to be ver- 15 
ified at the time of user authentication. 

24. A biometric information obtaining apparatus as set 
forth in any one of claim 1 through claim 22, wherein 
said biometric information obtaining means (1 0) ob- 20 
tains such series of partial images of the body part 

as verification biometric information, which is ob- 
tained from a user to be verified at the time of user 
authentication, said verification biometric informa- 
tion being compared with registration biometric in- 25 
formation forverification. 
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FIG. 2A FIG. 2B 




FIG. 3A FIG. 3B 
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FIG. 9 




FIG. 10A FIG. 10B 



FIG. 11 A FIG. 11B 
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FIG. 12A FIG. 12B 
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FIG. 14A FIG. 14B 




FIG. 15A FIG. 15B 
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FIG. 17A FIG. 17B 
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(54) Biometric information obtaining apparatus 

(57) The apparatus enables a user to recognize the 
way he is moving his finger with respect to, for example, 
a sweep-type fingerprint sensor so that the user can 
easily and surely learn an appropriate way the finger 
(body part) should be moved. A velocity detecting 
means (202) detects a velocity at which the body part 
moves with respect to a sensor (10), and an image gen- 
erating means (206) generates an arbitrary pattern, of 
which a portion corresponding to a position where the 
body part is located when the movement velocity is de- 
tected is altered according to the detected movement 
velocity, and the generated pattern is shown on a display 
(30). 
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